2 links tagged with all of: simulation + reinforcement learning
Click any tag below to further narrow down your results
Links
@daphnesolves on X
A developer ports the weakly electric fish multi-agent RL simulation from Python to C, using PufferLib, and gets training to about one million steps per second. The result is a strong fish policy trained in roughly 10 seconds, against 6 to 9 hours in the original setup.
- The C port started at about 40,000 steps per second, and switching most doubles to floats added roughly 30% more speed.
- Profiling showed electric-field calculations dominated runtime, so restricting sensor calculations to elements within each organ's short sensory range cut the work sharply.
- Final throughput reached 1.85 million simulation steps per second, against about 4,300 for the reference Python environment, and a 527-run sweep finished in 12 hours.
+ weakly electric fish
+ pufferlib
reinforcement learning
+ multi agent rl
simulation
+ biology
+ optimization
This paper introduces Qwen-AgentWorld, large language models trained to simulate agentic environments across seven domains using over 10 million interaction trajectories. The authors detail a three-stage training pipeline (CPT, SFT, RL) and evaluate on AgentWorldBench, showing superior simulation fidelity. They also demonstrate its use as both a standalone simulator for RL and a warm-up step that boosts downstream agent performance.
- Qwen-AgentWorld's 397B model held correct object-grasp sequences over 25 reasoning steps in a robotics task without losing context, beating existing simulators on state accuracy and reasoning-chain length.
- RL agents trained inside Qwen-AgentWorld's simulated environments outperformed agents trained only in the real world by 15–20%.
- Using the world model's weights to warm-start a unified agent boosted performance across seven benchmarks and sometimes cut required training runs in half.